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Abstract 

We investigate the growth optimal strategy over a finite time horizon for 
a stock and bond portfolio in an analytically solvable multiplicative Marko- 
vian market model. We show that the optimal strategy consists in holding 
the amount of capital invested in stocks within an interval around an ideal 
optimal investment. The size of the holding interval is determined by the 
intensity of the transaction costs and the time horizon. 



1 Introduction 

An idealised model of investment is a sequence of gambles where the spec- 
ulator chooses at each time step her position. The game is multiplicative if the 
pay-off is proportional to the capital, and it is Markov if the new capital and new 
position depend parametrically only on the previous state. The relevant issue con- 
sists of determining which strategy the speculator should pursue, which in general 
depends on the preferences of the individual investor. A reasonable choice is to 



assume that the investor wishes to maximise the growth of her capital. In this 
paper we will investigate such strategies for finite-time investment horizons. An- 
other interpretation is then that we will be looking at investments in a class of 
quadratic utility functions, where, for definiteness, we take certain values of the 
parameters, which are then those that correspond to growth-optimal investment. 
The main novelty is that we include transaction costs. With the special functional 
form of the costs studies here, the investment problem can be solved analytically 
by mapping to an example in quantum mechanics. 

Growth optimal criteria for multiplicative Markov process were first inves- 
tigated by Kelly in the context of information theory [[14]]. Criticisms from the 
viewpoint of utility theory appeared later in the economic literature. For recent 
reviews the reader is referred to refs. [jT3|, [TJJ, |p. A related but separate question 
is what to do if the laws of the gambles is unknown, but has to be deduced from 
observing price history (or other information). A widely recognised procedure 
is then the "Universal portfolios"^ [7]], which can be considered growth- optimal 
strategies, using continuously updated guesses for the parameters of the model. 
Growth-optimal criteria are therefore robust to the market participnats lacking 
knowledge of the statistical laws of the market. This makes them interesting also 
over finite-time horizons. 

In a previous contribution [|]] we derived from a discrete multiplicative Markov 
model the continuum limit dynamics of a stock and bond portfolio in the presence 
of linear trading costs, i.e. proportional to the absolute value of the capital moved 
by the investor to balance her portfolio. Our main result can be summarised by 
saying that on an infinite time horizon the investment optimal strategy consists of 
allowing the amount of capital invested in stocks to fluctuate freely within an inter- 
val around the value of the optimal investment in the absence of trading costs. The 
size of the holding interval was shown to depend non-analytically on an adimen- 
sional parameter measuring the intensity of the transaction costs. In [Bp we took 
the existence of growth-optimal strategies over infinite time horizons for granted. 
This has recently been proven, and in a much more general setting [|]]. A conse- 
quence of the result on the holding interval is that that for financially reasonable 
values of the parameters in the model, convergence to the full dynamical solution 
in the infinite time horizon limit may be surprisingly slow, of the order of years of 
trading. It is therefore natural to address the question of the time evolution of the 
growth optimal strategy over finite investment horizons. The question has rele- 
vance also in the perspective of deriving an option pricing procedure from growth 
optimal criteria. 

In the present paper we tackle the problem of an optimal strategy in a market 
model where trading costs are described by a quadratic function of the fraction 
of capital invested in re-hedging the portfolio. One advantage of this model that 
it is mathematically simpler, since the costs are analytic. Indeed, we will show 
that the model can essentially be solved analytically, which is interesting in itself. 
From the financial side, one can compare with the market impact phenomenology 
of [|9|]. Suppose one first buys w worth of shares, and sells off shares to recover 
the same amount w. By actively seeking a deal one is forced to buy high and 
sell low. The turn-around cost of the operation is then on average w 2 /\, under 
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the assumption that w is much less than the market depth A. If one assumes that 
market depth grows proportionally to the total wealth of a typical investor in the 
market one recovers the model we study here. The analysis we will present can 
therefore, for example, be relevant to fairly large operators in a market, the actions 
of which move market prices, to some extent. 

The paper is organised as follows. In section |2| we state the optimisation prob- 
lem in the framework of the Hamilton- Jacobi-Bellman equation, well known in 
mathematical finance. In section H we show that the non-linear Hamilton- Jacobi- 
Bellman equation governing the dynamics, in our example, is solvable in the small 
transaction costs limit by means of a multi-scale perturbation theory (see for ex- 
ample [ |10[ |5J], or [p"2|], chapter 9). This is the main technical result of the paper, 
and reduces the non-linearity to a normal form. All higher order corrections can 
be computed from ancillary linear non-homogeneous equations. In section |] we 
solve analytically the normal form of the non-linearity and compare the result with 
the numerical solution of the original Hamilton-Jacobi-Bellman equation. The ap- 
proximation turns out to be very accurate for realistic values of the parameters in 
the model. The last section is devoted to a discussion of the results. 



2 HJB equation for trading costs 

The stock and bond trade dynamics is in the continuum limit governed by the 
system of stochastic differential equations 



dW t = [m - lf{pn t)\ W t dt + ap t W t dB t 

dpt = [f(pt, t) + a(p t ) + jptf(pt, t)] dt + b{pt) dB t 



(1) 

(2) 



with 



a(p t ) = p t {l- p t ){p-a 2 pt) 
KPt) = <rpt(l-Pt) 



(3) 



In the equations (Tj])-(Q), W t is the total wealth of the speculator at time t, and 
p t is the fraction of the wealth held in stocks at time t. The stochastic control / 
represents the action taken by the speculator at time t to re-hedge her position in 
the market. The stochastic control is to be determined as a function of p t and t, by 
maximising the expectation value of the wealth growth: 



X(x,t;T) 



E pt=x In 



W T 



E 



pt=x 



ds 



a' 



PPs 



-Pi - if 



(4) 



The expectation E pt=x is conditional on the fraction in stock process p t having 

value x at initial time t. The time difference T — t is the time horizon of the 
speculator: the time period wherein she wants to optimise her position in the 
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market. The optimisation is performed with respect to two conflicting effects. 
On one hand, the market fall-outs raise or lower the relative amount of invested 
wealth, motivating the investor to re-balance the portfolio. On the other, the re- 
hedging carries trading costs. In this paper we model these as 7/ 2 , where 7 is 
some given positive valued constant. The derivation of the equations (jl|)-(@) from 
a discrete multiplicative Markov game is given in appendix. 

For any stochastic control / such that the system (fi]), (Q) is well defined, the ex- 
pectation value of the wealth growth must obey the dynamic programming equa- 
tion 

tp, 22 
d t X + [/ + a + 1X f}d x X + -d 2 x X + fix - - 1 f = 

X(x,T;T) = (5) 

The functional dependence of the drift a and of the diffusion coefficient b on x is 
defined by (0) and has been omitted to streamline the notation. The optimisation 
problem is well defined only when the boundary conditions in x are specified. 
The solution of the dynamic programming equation (Q) has by construction the 
form of an average over the transition probability density of the stochastic process 
p t . In the model considered here we can neglect capital borrowing and lending 
since (under proper conditions on the parameters) the process will never move 
to p outside the interval [0, 1]. The conservation of the probability measure then 
implies 

d x X(x,t;T)\ x=0 = d x X(x,t;T)\ x=1 = (6) 

which are adjoint to the reflecting boundary conditions imposed on the probability 
density. 

The growth is stationary versus the control / if 

^ = (7) 

For any finite 7, the extremum condition yields a relation between the stochastic 
control and the expected growth: 

(l + 2 1 xf)d x X-2 1 f = (8) 

The extremum is a maximum for 

*(/, A) = [/ + a + jxf]d x X + jd 2 x X + fIX -^- 1 f (9) 
provided fjTJ, [llj] 

27X&A-27 < (10) 
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Thus, the optimal stochastic control is 

/= 9 (11) 

27(1 -xd x \) 

The Hamilton-Jacobi-Bellman [[R]] equation governing the optimal dynamics is 
then 

d t X + ad x X+ Al f_f dx x) + Y d * X + ^x-^f = 

X(x,T;T) = (12) 

d x X(x, t; T) \ x=0 = d x X(x, t; T) \ x=x = 

This equation is time autonomous and therefore the solution can be sought in the 
form 

X(x,t;T) = X(x,T-t) (13) 

In view of the ensuing analysis of the Hamilton-Jacobi-Bellman equation it is use- 
ful to identify the canonical dimensions of the quantities involved in the problem: 

[A] =0 [x] = 

[a 2 ] = [1/t] M = [l/t] (14) 

W = [t] [f] = [l/t] 

A trading day can be assumed to define the time unit. Note that the dimensions in 
dl4| ) are partially different from those given in [Q] since the functional form of the 
friction is different. 



3 The transaction cost free limit and its leading or- 
der correction 

In the absence of transaction costs the speculator is free to take un-restrained 
actions to always keep the fraction allocated to stocks constant 

P° pt = 4 (15) 
This gives pTJ, |T^p the absolute value of the wealth growth: 

X(x,t;T)\ y=0 = ^(T-t) (16) 

Zi (J 
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In this paper we assume /i and a 2 axe such that the ratio ( JT3| ) lies inside the interval 
[0, 1], see the appendix for discussion. 

In the frame-work of the dynamics programming equation, the absence of 
trading costs renders (|5|) linear in the stochastic control /. The optimal growth 
is achieved by wielding a singular control strategy which restricts the support of 
the probability measure of p t only to the point p opt . Thus, when trading costs 
are present but "small", it must be possible to seek to solve of the Hamilton- 
Jacobi-Bellman equation ( |T2| ) by means of a perturbative expansion around the 
limit <JT6t). In order to do that it is convenient to translate the origin of the x 
coordinate according to 

x -> x + (17) 

For any finite a 2 , the adimensional parameter measuring the intensity of trading 
costs is 

e = a 2 7 (18) 

However, the perturbative expansion cannot be analytic in e. This can be argued 
a priori by observing that Oseledec' theorem JT7] ] predicts for the asymptotic be- 
haviour of the wealth growth 

lim X(x,t;T) ~(T-t)£ (19) 

t i — oo 

It is therefore natural to assume that the dynamics of the wealth growth A should 
involve two typical time scales. The first time scale should be i~ x governing the 
asymptotic regime, while the second should describe the characteristic relaxation 
time to the asymptotic regime. Such considerations, together with the singular de- 
pendence of the Hamilton- Jacobi-Bellman equation (|12|) on 7, suggest the Ansatz 

A(M;T) = ^(^,^,^*) (20) 

The first time dependence refers to the linear growth. The second describes the 
relaxation process and it is conjectured to satisfy in e the characteristic time-spatial 
scaling relation of diffusion processes. From ( J20| ) it appears that small transaction 
cost expansion of A entails a multi-scale perturbation theory with times 

T-t 



and consequently 



e 

T — t 



d t = - e d r + -^d s (22) 
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The "spatial" rescaling 

finally yields for 
the equation 



x 



V = <f(y,r, s) 







4(a 2 + e 3 / 4 (/i + e 1 /V 2 )^) 

2\2 



^ + e^ya 2 ) 2 ^+(e^y-l)a 2 ) 2 2 _ 



2 a 6 



, 6 j /( / x + eV 4 ? /a 2 )(/x+(e 1 / 4 j /-l)a 2 ) a 

+ n Oyip 



(23) 



(24) 



(25) 



The equation admits now an analytic expansion in powers of e 1 / 4 the solution 
whereof is amenable to the form of the series 



/j, r 
2^2 



(26) 



n=0 



The equation for ifo{y, s) is non-linear and provides the normal form of the non- 
linearity involved in the Hamilton- Jacobi-Bellman problem ([12]): 



d s <Po + ~ v T^ Uy + —%<Po - = 



a 2 (d x ^f D 2 
2 



4 2 xr 2 

The effective "diffusion" constant D 2 in (E71) is 



1 



(7" 



[/J 2 ] = [1/t] 



(27) 



(28) 



Terms of higher orders in the expansion d2~5j ) are obtained by solving linear non- 
homogeneous equations. The first of them is for example provided by the solution 
of 



1 D 2 

d s ip 1 + -a 2 d y <p dyipi + -yd 2 ^ 

(2^ 2 ya 2 ( f ,-a 2 ) + 2wa 2 ^-a 2 ) 2 ) a2 
+ d v^ = 

7 



(29) 



The conclusion of the above analysis is that the leading order in the multi-scale 
expansion captures the effect of the non-linearity involved in the optimisation 
problem. Otherwise stated, within leading order in the small trading costs limit, 
equation ( |1"2| ) can be consistently replaced by the simpler model problem 

^ f a 2 x 2 _ 



X(y,T;T) = 

d x \(x,t;T) = d x \(x,t;T) 



(30) 



The model problem is the Hamilton- Jacobi-Bellman equation associated to the 
dynamic programming equation 



D 2 u 2 ct 2 t 2 

f 

The extremum conditions here become 



d t X + swp{fd x \ + —d*\ + -^ i - — - 1 f 2 } = (31) 
2 Za z 2 



d x \-2jf = 

-2 7 <0 (32) 

stating that the solution is always a maximum. This fact guarantees that ( |3T] ) 
provides the optimal capital growth for e small enough. 



4 The logarithmic transform 

The model problem ( |3"0"| ) can be mapped to a linear equation by the logarithmic 
transform 



\(x,t;T)=AknJ;(x,T-t) (33) 

provided 

ip(x,T-t) > (34) 

The initial condition for the function if) is 

ip{x,0) = 1 (35) 

The value of the constant A is fixed by imposing the cancellation of the non-linear 
term. Namely, by setting 

A = 2L> 2 7, [A}=0 (36) 
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( jnf ) is mapped into the imaginary time Schrodinger equation 

ip = 



D 2 1 

fi^V + + 5- 

2 x 2D 2 7 



/i 2 a 2 x 2 
2^2 



(37) 



The equation further simplifies if the Neumann boundary conditions on a finite 
interval of length proportional to e -1 / 4 are replaced by Dirichlet boundary condi- 
tions at infinity: 



lim ip(x, t) = 

\x\ 1 oo 



(38) 



As a matter of fact, ( |3~7| ) admits on L 2 (M) the explicit solution (see for example 
appendix A. 4 in [|IE|]): 

i/j(x,t) =e^^J2 e ' E2nt ^(x) [ dyij 2n (y) (39) 



where 



-En 



V2 7 



nl 



-\n+- 



1TT D 2 



1/4 



e 2rfl2 



.r 



1 

T 




(40) 



for H n (£) the n-th Hermite polynomial. The series (^) is restricted to even values 
of n since Hermite polynomials are of even/odd parity for even/odd n 

H n (-0 = H n H n (0 (41) 

The logarithmic transform is well defined on ( |3"9| ) due to the exponential decay of 
the coefficients in the series 



y/2 n n\ \tttD 2 



1 



1/4 r j I / \ (2n-l)!!y^2 

<*y^Mi/) = 2n(2n) , 



(42) 



Hence, the average optimal growth of the capital as a function of the fraction 
initially invested in stocks sona time horizon T — t is 



X(x,t;T) 



D a t 



2 a 2 2 

oo 



(T-t) 



a 2 t x 2 



+ D 2 a 2 r 2 \nV2 



+ D 2 a 2 r 2 

. n=0 



(2n - l)!!e" 



■In- 



2 n (2n) 
9 



H- 



2 n 



(43) 



x 10 3 
20 | 




0.3 0.4 0.5 0.6 0.7 

Fraction of capital invested in stocks x 



Figure 1: The control potential 27 V as defined in ( |46| ) for /i = a 2 /2, o = 10 2 
and 7 = 10 2 is plotted for time horizons of T - t = 500, 1000, 2000, 2500 days 
using both the exact solution of the Hamilton- Jacobi-Bellman equation ( |T2| ) and 
the approximate solution (ft3|). The characteristic decay time to the asymptotic 
regime is r/2 ~ 1000 days. The innermost parabola is obtained from the asymp- 
totic expression 



In agreement with Oseledec' theorem (|19|), convergence to a stationary state is 
exponentially fast with rate equal to 



T 

2 




(7" 



(44) 



From the last identity it is also straightforward to verify the consistency of ( {33D 
with the multi-scale Ansatz (j20l). Finally, the time asymptotic form of the solution 
can be extracted directly from ( |30| ) as it was done in our previous paper [|3|] by 
using the information (U% provided by Oseledec' theorem. 



5 Discussion and conclusions 

The exact solution of the model problem ( PD| ) gives a qualitatively and for a 2 7 
small enough also quantitatively correct description of the investment strategy 
that a speculator should pursue in order to optimise her profits. The strategy is 
most conveniently summarised by looking at the potential V 

f(x,T-t) = -d x V(x,T-t) (45) 
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Figure 2: The exact and approximate optimal growth A(0, t) is plotted versus the 
time horizon for the same parameters used in (H7T). The two lines almost overlap. 



associated to the optimal stochastic control. Within the same approximation lead- 
ing to (|30|), the potential can be defined as 



V{x,T-t) 



X(x,T-t) + X(0,T-t) 



27 



2 7 



(46) 



The behaviour in time of the potential is illustrated in figure [IL In the figure the 
same quantity ( P7j| ) is also plotted when A is obtained from trie solution of the 
exact Hamilton-Tacobi-Bellman equation (|T2|). The resulting profiles are practi- 
cally indistinguishable for financially reasonable choices of the parameters in the 
perturbative regime. The shape of the potential entails a fast decay of the proba- 
bility density of the fraction of capital invested in stocks versus the deviation from 
the ideal optimum (JT~5|) . The observation justifies a posteriori the use of Dirichlet 
boundary conditions in the solution of the model problem. As a matter of fact, the 
modification of the boundary conditions affects the average (Q) only in a region 
where the probability density is practically equal to zero. 

The potential gets steeper when time to investment horizon is long, tending 
asymptotically to a parabolic shape 



x 



asympt. 



X 



— (T-t)»T 



(47) 



In this limit the speculator aims to always hold the invested fraction of capital 
in a finite interval around the optimal investment fraction p opt of ([15]). In the 
asymptotic regime the fraction of* capital invested in stocks tends to an Ornstein- 
Uhlenbeck process [Q] the invariant measure whereof having variance D 2 r/2. 
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This latter quantity provides the typical size of the holding interval. When T — t is 
on the order of r, or smaller, the solution is given by the complete expression (PO) , 
with corrections from the higher order terms in ((2^). The general behaviour ofthis 
process is a successively flatter potential leading to a larger holding interval, see 

Fi §J 

The results of the present paper together with those of our previous contribu- 
tion [Q] support an "investment confinement" picture as growth optimal strategy 
for multiplicative Markov market models with trading costs. According to such 
picture, differences in the modeling of the trading costs are reflected only in the 
different non-analytic powers of e on which the size of the holding interval de- 
pends. Differences in the modeling of transaction costs do not seem to affect 
the typical time scales governing the relaxation to the asymptotic growth state. 
Namely also in the case of quadratic market friction, a daily relative stock price 
fluctuation a 2 of the order of 10~ 4 per cent with e equal to 0.01 yields for decay 
rate the value of 700 days. The result is in agreement with the prediction of the 
dimensional analysis in [Q]. 
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Appendix 

We present here a derivation of the continuum limit market dynamics slightly 
different than the one given in [BJ|. At time t the wealth in stocks is, in units of the 
total wealth, 

w (Stocks) = ^ ^ (4g) 

The variation in one time step of the wealth in stocks occurs in consequence of 

• the market fall-out u t 

• the action A\t of the speculator who re-hedges her position in the market. 
The fraction in stocks at time t + 1 becomes 

^Stocks) = ^ + ^ m 

The total wealth at time t + 1 is affected by the stock investment profits or losses 
and by the trading costs entailed by any re-hedging: 

W t+1 = [1 + p t (u t - 1) - AF y (Axt)] W t (50) 
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Most generally trading costs are described by a semi-positive definite function 

AF 7 vanishing only if the investor remains idle, i.e. when Ax is zero. 

From ( 1501 ) m e variation of the invested capital fraction p t over a time unit is 

l + pt{u t - 1) - AF 7 (Axt) 

The continuum limit is attained by replacing 

u t — 1 — > pdt + a dB t 
A X t ^ fdt 

AF -> jF(f)dt (52) 
The differential <iw t gives the relative stock price 

du t := = w dt + a dB t (53) 

Pt 

The stochastic differential equation is defined according to the Ito convention. It 
has the solution 

Pt=p e\ 2 > (54) 

A value of outside the interval [0, 1] thus corresponds to strong inflation or de- 
flation rates. If borrowing and short-selling is not allowed, the optimal strategy 
would then simply be to keep all money in stock or all money in bonds. If bor- 
rowing and short-selling is allowed, the problem becomes again similar to the one 
studied here, but the relevant intervals would then either be [1, oo] or [— oo, 0]. 
After a little algebra one finds 

dW t = m W t dt + ap t Wt dB t - lW t Tdt (55) 
dpt = [f + PtO-- Pt)(p - cr 2 Pt)] dt + [ap t (l - p t )] dB t + jp t J 7 dt(56) 

Equations ([[]) and @ are recovered by setting 

T=f 2 (57) 

The optimal control diverges in the limit of zero transaction costs so to hold the 
fraction in stocks tightly to the constant value p/a 2 . 
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